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Plftld o£ the Inrontiflft 

The present Invention relates g^ierally to the fiield of 
ctsBpoterized teaching syst^, and mora particularly but not by 
5 way of limitation^ to an liqproved portable imltl-inodal 
automated educational and entertainment aystem. 

BaritaiKitvinfl Art 
Educational eyatema and devices have heretofore bean 
proposed ae teaching aldSf audb ae for teaching multiplication 

10 tables and the llke^ 'ShB prior art sfystama and devices have 
generally been celativ^y ainf>ia with liaited use capabllltfes 
and veraatilltYr « extremely complex tt^ing it difficult fbr 
students and instruotora to operate* 

One prior art device (U.S. Patent Ho^ 3,009,262) with 

15 llinited versatiliigr coniprlses a light bulb carried on • 

intersecting perpendicular rod members^ the rod i»iiber» being 
jQOvable independently in two directions to locate the light 
bulb under an answer^ aiha anaiver ^ich overlies tbe positioned 
light bulb depends i^on the distance th& bulb Is iftoved In 

20 perpendicular direetions and indicates for example r tte product 
of tbe numbers at their reactive distances along the axes 
from the starting edges. 

Another prior art device, taught in Patent 
3,771,240, ocnprises a mrd having interconnected conduetisae ... 

2S elexnents over which a second card is positioned i tbe second 
card defining selected math^tical problems and possible 
solutions. Probes are used to select the problems and their 
proper solutions.. Light bulbs are engaged upon choosing a 
correct solution. . 7 

30 Still another prior art,: disclosed in Q.S« Patent No. — 

3,834,042, teaches a computational device for teaching 
mathematics by means of an aj^ratus for indicating correct and 
incorrect solutions to an equation having two independent 
variables for selected variable values. %e apparatus includes 

35 & printed circuit board and eleetrlcally^ conductive strips, the 
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oofidnctlve strips £onnl2ig a family cC curves r^raeentlng 
solutions to a desir^a eq^atim o£ two ixidependaiit variables. 
TbQ fsaally of curves is arranged ia a manner eo t±at the 
distance along one edge o£ the board repre^nts the value oC 
5 ens of the independent variables, ai^ the distance along 
aaotiier edge o£ tto board n^tresents the value o£ the other 
Independent -variahle. The intersection of the lines parallel 
to the edges o£ tbe board intersecting over the curve xepre* 
sents the solution to the equation of tte two variables. Bach 
of the solution curves is connected to an ^ectrically conduce 
tlsg possible solutim i&arker displayed on the tpp panel* A 
test pap^ is conneoted to a relay switch to energlM tine relay 
when the test probe is brought into contact vith the proper 
solution iBenber to idiich the voltage la conducted fEom the 
U solution curve* l!he test probe contain a switch arable 

pressure on the probe to engage a selected one of the two solo* 
tlon Indicating lamps, the Incorrect l«fl^ being ordinarily 
selected and the correct answer laipp being selected positive 
potential beiog detected fay the probe whidi the relay 
20 energised, 

a*S* Patent No* 3,761,877 is reprasentative of the more 
ooopleK prior art ^t^ns and i^paratusesi^and is a system that 
utilises a conpoter graphics* Input terminal coa^rlslng an 
Optical or li^t position sensing device, a semi- transparent 
2S plate mounted in optical relationship to tiie sensing device, 
and a light^^emitting-^s^^lus movable by the operator over the- 
plate surface gainst the sensing device. The sensing device 
provides an analog output correspmdlng to the position of the 
stirlus on the surface of the sensing panel and an analog to 
digital converter provides a digital out^t for feeding 
positional data to oasputers and/or other digital or analog * 
operated equlfments- Hhis- tamper of -systair atilt^*^a'"cehtralis»Sfl 
computer and is *not portable by its very nature, 

Anothoc tgrpe of character recognition systwo, disclosed in' 
3^ U.S* Patent NO. 4,194,147, utilizes the moveniieQt of a stylus 
across a predesignated data pad comprising three more 
electrically conductive areas. As the s^lua traverses the 
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eleotrieally conduotlve ar^, a digital. signal is produced 
whlfih^ when oanpared with a ^restored tania of characters^ la 
either recognized or declared an inp^t error. Tb& signal is 
than transmitted to a ooqpater or other device for processing* 
5 Another t^pe of prior art Character recognition systm^ as 

disclosed In 0«8« Patent Nd» 3,835 rtfS, provides for data Input 
by 4 stylus that has a ntovlng sorface or ball, the sq^las being 
ranstrocted so as to produce a digital slgbal representltive c£ 
the movoent of the surface or ball. The digital signal can be 

10 transmitted either by wire or RF transmission to a con^iuter or 
other similar device wbexevgpon It is decoded or reoognised as « 
valid character or declared an Input error* 

numerous other edooational and character recognition 
^sterns and devices have been proposed. However/ as with the 

15 before described prior art sysCMS and devices, the other 

educational and chiaracter recognition systems and devices are 
Inherently inflexible, substantially limited to function and 
versatilii^, or extremely oonplex in construction and 
operation. Thus, a need has long been recognized for autanated 

28 teaching aids an^/or entertainment systems which are portable, 
and yet have substantially unlimited versatility. Further, 
autcaiated teaching aids are desired tAicsh require relational 
positioning of ii^t data by the user substantially 
ocrresponding to manual operations and procedures In the 

25 solving of mathematical ptoblems, quelling and the like* 

Sgpffiar y ^ Inventtol 
The present Invention relates to a multi^nodal automated 
educational and entertainment device having improved functional 
versatility a»3 which requires relational positioning of Input 

30 aata by ttte user which corresponds to required manual 

operations and procedures'* -Broadly |- the* present invention 
cca^ises a tablet having a non-relational section* iar input of 
control or predefined Infoeaatlon and at least one relational 
section for input of data, a s^lua for activating the 

35 non-relational and relational sections of the tablet, a 
microcomputer logic unit for processing signals from the 
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nonrrelational and relational $ectlOQ8 of the tahlet, a naffloty 
mit Sat storing pcograns and data base foe datemlnlng the 
aocnrdcy or Inaccuracy oC the signals provided the 
tnicrocasDpater logic unit, visual and audio oot^ts for c^ator 
3 rainforcement and a povsr source for activating the device. In 
ona aspect the preeent Invention provides for a sequence of 
Steps for operating the ffiulti-^oodal automated educatiOQal and 
entertainnffiiit device under the oontzol oC stored programs* 
M object of the present inrentioa is to provida an 

10 educational and entertaimsent device having inproved 
functionality and vereatlll^* 

Another object of the present invention is to provide an 
edueatimal and entertalnzsmt device which reqalree relational 
positioning of input data fay the iteer that cortesprads to 

15 required manual operatlns and procedures in solving 
natheiQatlcal problems and the lUce. 

still another object of the present invention is to 
provide a portable molti^nodal autesaated educational and 
entertainment device suitable for use as a "stand-alme" unit - 

20 or in ooioblaatim vitb a mater coiqpttter and a oosQunicatlon 
interface unit. 

Another c^ect of the present invention la to automate 
manual operations xeguired-in^anclassroom e^iviromnentf tberehjr 
reducing the workload of a teacher in educating cblldken» • 

25 Other objecsts^ advantages and features of the present 

invention will become apparent, py those skilled «ln tiie art frosn- 
the following detailed description when read in conjunction 
with the drawings and appended clalns. 

Brief Description e£ the Prswinas 
30 Figure 1 illustrates In diagrammatical fom a plurality of 

mttXtl«»]nodal. automated educational and entertainment devices ' ' 
constructed in accordance with the present invention, each of 
the devices connected to a master coopiter via a ccremunlcatlons 
interface unit. 

35 figure 2A is an isometric view of the malti^ncdal automated 
educational and entertainment device of the preset inventiWr 
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and Ulustratittg a stylus for activating data input pads 
fowling ralationaa and non^relationaX sections of the device^ 
Figure 2B ia a top plan viev of the nalti«iDDdal autoaated 
educational and entertainnent device 10 » 
5 Figure 2C is a side plan view of the niQlti-nDdal autcnated 

educational and entertainment device ID abowing the locatiM of 
the earphone jade 1€A, the- input/output jade 14Ar oo/off power 
switch 11/ and the stylus. 

Figure 3 ia a block diagram of the educational and 
10 entertainment device of Figure 2r 

■ Figure 4 ia an enlarged perspective view of a data input 
padf a plurality of ^idi form the relational and 
nwwrelatlonal sections of the device of Figure 2. 

Figure 5A is a top plan view a£ another «nbodiment bf an 
15 educational and entertainment device conatructed in accordance 
with the present invention, and illustrating a stylua tor 
activating data- input pads forming a relational aectiw and a 
plurall^ of non-relational sections of the device, the device 
ade^ted to receive an overlay mwnber for selectively providing 
20 access to a predetermined portion of the relational flection of 
the device* 

Figure 5B is a tc* plan view of » o^rerlay member ft*r use 
with the educational -and-entertaiisnmt device -of -*i9ure-5M--^ - : • 
Figure 5C is an enlarged perspective view of the stylus 

25 232* 

Figure. 6 is.. a loiic ^B3RA.'gcooBSB^^oy^i e(jm T i^ - 
educational and entertainment devices illustrated in Figures 2 
and 5« 

Figure 7 ia a logic and process flow diagram of tiie "define 
30 function" of the diagram of Figure 

Figure 8 ia a logic and process flow diagriaa of tte "solve 
function^ of the diagram of Figure • - • 

Figure 9 is a logic and process flow diagram of the "play 
' function" of the diagram of Figure 6» 
35 Figure 10 is a logic and process flow diagram of the •show 

m function" of tte diagram of Figure 6» 
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DescctetlQa o£ tihe Inreittloii 
Bj^erring nov to tite drawlogsr and more partioulorlj to 
figure Xr d plaralltar oS nuXtimodai automatda ^ocattanal md 
entertainment devices 10 .{hereinafter referred to as » 
^ BtttltiriBDdal devices) are coimected to a naater computer 12 

aof suitable means i au^ as an B6-232C interface protocol t 
represented by lines 14. Bach of the multi-model devices 10 is 
proTided vltb a hearings device 16 and a strlua 18*. Sbe hearing 
devioe l6 can be any suitable onit known in tbs art such as a 

^0 head pbonSf an ear pliigr or a speaker* Tb^ 8t?luB 18 can be a 
cognitive or non^oognitlve device. The stylos 18 can be 
electrically connected to the aultl«modal device 10 via line 
20, as fihownr by RF signals, or the s^los 18 can be 
independent o£ the fla3ltl*modal device 10 as ulll be more folly 

1^ described hereinafter. 

Referring nov to Figure 2Br the multi-modal device 10 
. coaprises a housing 30 having an upper side 32. A plurality of - - ' 
ix^t pads 34, 36 and 38 are disposed in. predeteriBinsd porticHss 
of the veges side 32 of the housing 30 and farm noQ-»relational 

20 seotions 40, 42 and 44, respectively. Similarly, a pluraliiy 
of incAit pads 46, 48, 50, 52 and 54 are disposed on 
predetermined sections of the v;^er side 32 o£ the housing 30 
and form r^at±Dnai*i5ections'56rS8> W,-62-ana-64^^^ ' 
respectively, the term *no&-relatlonal sections", as used 
herein, is to beunderstood to mean that there Is no poaitional 

sections", as used herein, is to be understood to mean that 
t^ere la a positional relationship between th^ input pads, such 
as Kould be true of the positions of digits In a mathematical 

30 problem, i.e. carrying digits, subtrahend, minuend and answer. ^ 
the input pads 34 and 36 which define the non-relational 

sectiMS 40 and 42 of the multi-modal- devtee My-apon" - * 

activiatlon by contact with the stylua 18, provide selected 
control signals to the multi-iaoaal device 10 and tiius to the 

35 master cozr^ter 12 (sbo«n in £lg. 1); whereas the Input pads 38 
which define the non-relational section 44 of the multi^modal 
device 10, t^on activation by contact with the s^lus 18, 
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proviae cognition of predefined Infonnatlon to the nuiiti-nodal 
device 10 and tbua to tbe master oomputor 12. !Siu8# the 
non-relational aectlon 44 meQ^ be alao referred to aff a 
cognitive section. Tba visual nar1cing# If Bay, aeooiqpliahed Iqr 
5 means ^ the atylus^ 18 en the input pads 34,36 and 38 of the 
tiQsr^lational sections 40^ 42 and 44 is inoonsequential to tbe 
operation of tto multl-ittodal device 10. The input pads 46, 48, 
50, 52 and 54 defining tha relational sections 56, 58, fiO, 62 
and 64 of the isulti'-'ioodal device 10 are specifically used for 
10 the narJcing of Q^nbols or infiosmation by msans of the stylus 
18. When the s^los IB is brought into marking engageiQsnt with 
any of the inpo^t pads 46f 48, SO, 52 and 54 defining the 
relational sections 56, 58, 68 ^ 62 and 64 of the nultl-nodal 
device 10, the activation of the input pad provides location 
15 indication signals to the imflti-inrfal device 10, while the 
narking is indicative of the Information associated \Axti the 
particular input pad looati»n.- • • ' 

The input pads 34, 36 and 38 in the non-relational 
sections 40, 42 and 44, as well as the input pads 46, 48, SO, 
20 52 and 54 of the relational sections 56, 58, 60, 62 and 64 are 
shown as being made up of two half pada, each half-pad being 
numbered. All upper half pads bearing the same nunber are 

-electrically connected- together ^withinr the^imiJtfr^ 

10 and may be viewed in a logical sense as comprising rows. In 
25 the embodiment shown, there are therefore 15 rows numbered' 1 

^rthrough IS . Litetfiser»>a^^4owePT J>alJ» d ?a d ai ' .b fea^^^ i^e j ^r . i . -rrvu-^. y^ 
number are connected together within tte multi-modal device 10 
and may be viewed in a logical sense as oonpriaing columns, in 
the rabodiment shown, there are therefora 16 columns numbered 1 
30 through 16. When the atjlus 18 is brought into OMtactlng 

engagement with an upper half ot.an.. activation -pad,, it provides 
. an input impulse to>4^e logi&^4jnit^82sca th&row.of&aoti«atioa«< 
and when the stylus 18 is farongbt into contacting engagement 
with the lower hal-f of the activation pad, it provides an input 
35 Impulse to the logic unit 82 on the column of activation.. 
Alternatively, tije s^lusr being brought into straddling 
engagement with the upper and lower halves of ar^ activation 
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pad pmvtda& Input ij^$e bo the logic, unit 82 cm tba cow and- 
column of aotivation. Ste logic unit 82 through its stoted 
pcogram Is than able to IdentlQr tho «pecl£lo pad location o£ 
actlvatlan by the atj^lus 18 £eoia the rov and oolma input " 
5 liopulaea cacaived* 

Tha nulti'-s^al davlce 10 further coiqpdLaes a visual *' 
diapl^ unit 66 and a volqe unit 68 (as ahom in Plguse 3) 
i^ch are used for positive waS/us negative xeinforoenant to 
the operator of the unilti-aodal device 10» The visual displai^ 

10 unit 66 ocnttptlsea a plurality of lights and alphanumeric I£l>3, 
liCfia or other displajf meahe well known In the art idkieh will he 
described in more detail hereinafter » 

In the operation of the xnulti^Mdal device 10, depending 
upon its design, ccortain infocnation may not be Input Into the 

15 logic unit 82 via ana^ of the input pads, sudi information none 
the less being ioportarit in the operation of the device, Pro^ 
vision by way of a sct£tcb pad 120 is made for marking. infocmar 
tion, using the stylus 18# in wder to facilitate the Cfperator 
In ressnbering this InfomatioQ* The smntdi pad 120 can be 

20 provided on the tapper side 32 of the houding 30 of the multl* 
modal device 10* The scribing surface of the scratch pad 120 
can be any eultafole means ^ch is capable of being marked i^pon 
with the stylus 13, tdien'^^he stj^Ids 18 Is c^^able dE prbducing* 
a markr such as a carbon core stylus or a sigrlcs having a f^t 

25 tip type pen. Further, the scribing surface of the scratdi pad 

....... 120 ehould be capaiaJB ^se^JisiBikiq^^^ 

the moltl^nodal device 10 vhen it is desired to r^ove a^y 
maiddngB from the scribing surface of the scratch pad 120, 

In a oogoitive systoo wherein i^opalsee ftm the stylus 18 

30 are deciphered by the multi-nodal device 10, misreoognitiw 
creates certain practical dlfficultiee.- Xn such six event, the 
indicia needs to rcsnaztea'mttt' nb -giia&nteds'tfa^ will be 
properly recognized the next time. It is conceivable that 
while the above misrecognition was In progress, marldng on 

35 another pad location had oasBsenced leading to confusion as to 
how to operate the device in an orderly fashion, in one 
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oetbodr aftee oo^etin? tbe aarldng oa « pad location, the 
operator pause* for a certain length of time until tbe system 
wcognizea the written Indicia and provides a visual or sound 
feedbadc to tbe operatrar indioative of 9 recognised input. Xn 
S another case, after eonpletijig the aarJting on a pad location, 
the ciperator activates an activate pad 70 with tbe slgflos to 
indicate cotfplation of walking on ai^ given relaticmal pad. In 
. either case, if the system mistecogniaes tbe Indicia, thwj 
' iaatead of rewriting tbe indicia, tha operator eifl^y usee the 
iO atylua to activate the jcpropriate nonrrelational data input 
pad to "fix" the error and awvee cft to the next opewtico, 

Beferring now to Figure 3, a block diagram of the 
muiti-wjdal device 10 is illustrated. The multi-nodal device 
10., in addition to the input pads defining the relational and 
IS non-relational sections, and the stylus 18 aa heretofore 

described, comprisea a po«*er source 80, a loglo unit 82 and a 
• meooiy unit 84 .: • lh» power waxGB 80 employed- to electrically - 
activate the multi-modal device 10 can be an internally 
disposed battery, swSb as a standard 9 volt recbatgable 
battery, or the power source 80 may be a conventional 
receptacle for connection to an external power source. When 
employing an intemaUy disposed battery as the power source 80 
it is deairablfr-to provide a-«b^ dO!«-trt«8«eKBSs/ooni»wet»r 
that the battery may be rediarged when required. 

When power is turned on, the signals received by the logic 
.vnlt-32 via buss 86 is. the result oLuictivatio n , of one or .. mo re. ■ 
pads on the upper side of tablet 32 by the stylus J8 la a 
pee-detsrmined sequence. The logic unit 82 can be any suitable 
unit capable of carrying out the desired functions, such as a 
microprocessor. Ibe logic unit 82 will process either control 
signals, location indication signals or data signals in 
.... .accordance .vdth. .its stored j^MgraBia-as. will be-jnore ,fiilly.-- 

described hereinafter wit* reference to Flgurea 7, 8, 9, 10 and 
11. ^ieai of a logic unit whidi nay be ea^loyed in the 
35 aulti-modal device 10 of the present invention is a 
microprocessor model 6502 CPD manufactured by Rockwell 
mtemational, inc. 
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The logic unit 82 is connocted to the upper side (tablet) 
30 via a bi-dizeetional buss 861 *and the logie uait 82- is 
conaectea to the stylus unit 18 via a bl-dixeotioaal buss 20. . 
The logio unit 82 is capable a£ controlling 13ie voltage levels 
5 in the bi^>directiondl buss 86 and the bi»directi€»al buss 20« 
By £lr&t setting pre-detetsained voltage levels on the bus 86 
mA/oc the buss 20^ and then sensing the voltage levels on the 
buss 86 and/w the boss 2Q, the logic unit 82 is able to 
^cipher tb» cperatioa of the upper side (tsiblet} 30 and the 

10 stylos unit 18* The ispilses sensed 1^ the logic unit 82 * 
through the buss 86 pcovlde location of pad activation 
Infracnation' to the logic unit 82 while the iapuleea sensed by' 
Mxt logic unit 82 through' the buss 20 provide logic unit 82 / 
vith in£ociDatlQn on die location <A pad ectlvetiw and/or the 

15 qrsibcl being narked on the li^t pad. 

The iseiQOcy unit 84 of the tuiilti-modal davice 10 la 
connected to the logic unit 82 via buss 88. The mezooxy unit 84 
stores prograins, data base and tsit^oracy scratch pad mesmyf 
either aingularly or in a plurall^ o£ nonrvolatile read/write^ 

20 xnenocy, sudx as bubble mams, or volatile 8&M (Bandon Access 
MeiKM:y) an4/or fiOH (Bead .Only M^sy}. Thusr tha m^ry unit 
84 provides an in£ormaclon signal to the logic unit 82 to 
Gonfwe with the ix^t iH^UId^a' fedelveS by *ttie logic unit '82 ' \ 
from the activation o£ the relational and non-relational input 

.25 pads o£ the vultl-iBodal device 10* 

.The voice .«nit -68 .•ls-*0Berably.-eomjeote*iao*1^^ 

82ft The voi<» unit 68 may ihcl\rie a voice synthesiser 69 
connected to the logic unit 82 via a buss 92 » An ou^t 
signal/ representative of process data in the logic unit 82, is 

30 directed to the voice sfntbesizear 69 of the voice unit 68 via 
the buss 92, the process data being In the fiotm of a signal 
used for both positlve^ and negative keinforCMsnt €C the ^ ' 
operator, as well as £or prompting the user, such as in the 
presentation of a epelling word and the like» Any suitable 
35 voloe synthesizer well known in tha art can be employed. The 
out^t oC the voice ^thesizer 69 can be delivered to the 
opwator throu^ a headset/earphone 16 via line 96, junction 

( _OMSt 
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9B, aijd line 100 • . Alternatively, the output signal o£ the 
voice qpithealzer S9 may be^ delivered to a epealcer 102 via line 
96, junction 9B, and line 104. In addition to the voice 
synthesizer 69, the voice unit 68 oowpriaes a tone generator 
106. The tone generator 106 is connectea to the logic unit 82 
via a busar 108» The tone generate IDS generates a tone or 
tune vhidi functions as positive and negative relnforceoents 
for the operator of the multi-modal device 10. The ou^t of 
the tone generator 106 can be delivered ix> the headset/earphone 
16, via line 110, junction 112, and line 116, or the speaker 
102 via line UO, junction 112, and line 114. 

The visual display unit 66 Of the nolti^nodal device 10 is 
connected to the logic unit 82 via a buss 118 • The visual 
display unit 66 cMq?rtse$ a plurality of lights and 
alphaxMBBric USDs or LCDs (shown in Figure 2), or suitable 
fflgans vbich provide a visual readout of the signal transmitted 
to the visual- displa? unit 6« from the logic onit-82-.-Thus','- • "'•^ • 
tmder E«cogram control, tiie logic unit 82 can produce the 
following: an output visual signal via buss 118 and the visual 
display unit 66; musical and other tone sounds via the buss 
108, the tone generator 106, line 110, junotlai 112, and line 
114 to the speaker 102, or via the buss 108, the tone generator 
106, line Ua^ -function- 112ra«*-Hi»*Hfritt^^ ... . - 

headset/earphone 16i epoedti or vocal eounds via the buss 92, 
the voice synthealzer, 69, line 96, junction 99# and line 104 to 
the speater 102, or. via the bupsJi, aia-..TOice-J5ynthesisec..6a^-M.M^ . 
the line 96, junction 98, and the line 100. to. the 
headset/earphone 16. As previously stated, the visual di^lay, • 
the musical or other tone sounds, and the speedi or vocal 
Instructions can be either a positive or negative reinforcement 
to the <s>erator of the ntultl-oodal device 10, such depending 

upon the .correlation J3ataffien«>the^da t a..A np ot. ^ in t a.. the ■ ^^^^.^^ 

multi-nodal device 10 and the program data contained in the 
oeooxy unit 84 of the taulti-modal device 10. 

The multi-nodal device 10 as described above is a • 
self-contained portable educational and entertainment ^stem 
capable of enabling the operator, such as a child, to carry out 
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preprogramed fonptloBS* Hdmver, tte capabilities o£ the 
nulti-^iBOdal deTlee 10 ean be BUbstantially increased, ^Aile 
still laaintalnlnsr ^ iadividual unit even isfaen a plucalltf of 
such units are used fay a npdber a£ different operators, by 
5 Interconnecting the plural i^ of the oniiti^inodal de^dces 10 to 
the loaster or central ooDputer 12 as Ulustrated in figure 1» 
la such instancer the logic wits 92 of 'eadi of tba molti-iaodal 
devices 10 has an integrated serial snd/ctt parallel l/Q 
(iqpiVou^ttt] port 124 omnacted to port 12fi of the master 

10 coi^ter 12 via a buss 14% Ibe interconnection of the I/O port 
124 of the logic unit 82 and the I/O port 126 of the master 
computer 12 allows transmissitti and receipt of control and 
iz^ixt/ou^t data in and from the master oompoter 12 to the 
logic unit 82 of eaCh of tiie mnlti'^Bedal devices 10 and 

15 vice»v)^r8a« 

^ shown in' Figure 2, the input pads 34, 36 ^ 38 of tiie* 
selective nm-relatic»ial sections 40, 42 and 44, the ins^ 
pads 46, 48, SO, 52 and S4 of the cespective relational 
sections 36, 58, SO, 62 and 64, asd the activate pad 70 in the 

20 nco^^relatlonal section 40 of the multi-aodal device 10 can be' 
of any suitable cmatruction* Further, such pads can be 
ranstruoted to-be -afiftlvated bs^ pr^^urer/ lligbf, B6at"or'any • • 
other means latom to the art^ For example, if the ix^t pads 
are activated by pressore the stilus 18 van be an ordinary 

29. pencil or pen sfhidLasakOfe phyaicallff->connec t e a. .tn .houstog~H^;>-%^- 
30 of the multi*aodal d^ce 10. ISie relational and 
Don-relational ii^t pads, pbjfdically located on the upper 
sorface 32 of the body portion 30 » nay be oanstruoted variously 
audi that thef may be. no mose tton d^narcations, vlth- svitdiee, 

30 aensors or other means knom to the art ondemeatii tbem for 
- detecttoft of activatioii* -^hus^ aie-^inptxt'^datarta'^ 'iogic^ 
unit 82 via the inpat pads for the selecticn of the deaired 
functions, such as control, (xgnltlcn input, display or the 
lUce, can be accon^lahed by either using the s^lus or one of 

35 the operator's fingers to s^y pressure tp the required input 
pad in the predetenoined nan^-relational section of the 
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jmlti-fflodaJl de^oe 10, vlille the pressnre of oazXlng indicia on 
the relational pads proTlda looation iodication is^lsas to tbe 
legio unit 82. 

Hhile actxvati<si c£ the varioua pads of the nulti^nodal 
5 device 10 can be ac«»«pll8hed in several waya as daactibed ^ 
above, and tha pads can be fabricated oC varieos troea ^ 
mterial8# confignraticns and designs, desirable resnlia Have 
been obtained nben the input, pads of tbe malti-nodal device 10 
are constructed as lilostrated In Figure 4. Since each of the 

10 iiiput pads, i.e. the li^nit pads foradng each of the relational 
sections, non-relational sections, and ti» activate pad 70, are 
aubstantially identical In eonatruction, only the activate pad 
70 will be described in detail vitti reference* to Figure 4. 

The activate pad 70 conprises a body portion 130 having an 

15 upper surface 132 and an opposed lower surface 134. The body 

portion 130, depleted as having a substantially drcular 
. conf igu>ration> is charaotac4se*<iaffiiav±nr a-flrsfhalf IW-and- — 
a second half m. 59» body portloii 130 is constructed of an 
electrically conductive fflatetial and an insulating medium 140, 

20 sueb as plastic, is disposed therein so that tlie first half 136 
of the body portion 130 is electrically insulated fcon tbe 
second half 138 of tbe body portion 130. An electrically 
- conductive lead or ptn ua-ls secured^ Uie flrsc-faglf-iae^ 
the body portion 130 so as to extend from the lower surface 134 

25 of the body portion 130 substantially as shown. Similarly, en 
electrically conductive J.ead.oii>plft -144 M .fieoqred-*a.-tha - 
second half 138 of the body portion 130 so as to extend fra» 
the lower surface 134 of the body Eortion UO substantially as 
sboMi. Thus, in an assembled position of the activate pad 70 

30 with ti»e housing 30 of the BUlti-modal device 10 the leads or 
pins 142, 144 contact tiiejelecttical .circuit conUinad within 
the housing 30 .o£.the nultiasmodal-desd^e. lOvsuoh that- 
electrical signals can be^ generated when the ii^t pads, such 
as the activate pad 70 r are activated by movenient of tho stylos 

39 18 across the upper swrfaee 132 of the body portion 130 

heretofore characterised as the first and second portions 136, 
138. 
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AnjT suitahlQ eleetrloall; oondootlve ifiat^rlal can be 
employed to fabrleatci the body ^wtlon 130 q£ ti» activate pad 
70 and eacb of the ii^t pada forsdng the relatlcnal and 
non-relational section? of the tttnltl-HSOdal d^iee 10* Sudb 
5 mterlale are veil Xx^wn In the art and thus a fottlier 

espianation of such materials la not believed to be neeesaars^ 
herein. Forthmr, the xsggesr surface 132 of the boe^ portion 130 
of the paiSa fdraitig the nonrrelational seotions 40, 42, and 44, 
as veil as the' activate pad 70 te treated or finished au^ 

^0 that marking the stylud is sdnindzed or Inhibited^ However, 
sliiQe indicia are loarked on the pads forming the relational 
seetlona 56, 58, 60, 62 end 64, i.e., Inpit pads 46, 48, 50, 52 
and 54, reapeetively, the qpper surtace 132 of eacb of the 
input pads nay be formed of a material for vritit^ on with a 

15 carbon base tip or an ihlc bearing electricaUy conduotlng fiber 
tip* However, in such instances the i^pper surface 132 of each 
of the bod^ portions^ of * the Input ^pad&iDUSt: be-fabrl'cated^to * --^---r 
facilitate being ntarked on as veil as being capable of the 
qperatoc erasing or raving tte satidngs onoe the use for sodi 

20 moi»v^T%fyq as s m&ans for visual recognition has c e a sed » It 
should be noted that while the activate pad 70 has been 
illustrated as having a circular configuration, the particular 
. - ... configuration- of the aotivate-pad^O>-«d-eadk-of-aia-other — ' — 

input pads of the relational and non-*relational sections cC tte 

25 aulti*ffiodal device 10 is not critical and can v»7 depending 
upon the particular asthetic. qualities- desired, in. the overall 
appearance of the input pads axtd their relationship with the 
bousing 39 of the .milti-^modal device 10. 

The stilus 18 employed to activate the input pads of the 

30 mnlti-'aodal device 10 can be a non-cognitive unit or a 

cognitive unit*. When alloying a non-cognitive tmit as the 
stylus 18 (as illustrated in Figures 1, 2, .3 -and 5 ) , the • 
non-cognitive u^t can be a carbon core pendl'-lDce ittester, 
which may be electrically connected to the logic unit 82 via 

35 xine 20 and the housing 30 of the molti-nodal device 10. 

optionally^ the carbon core pencil-like member may ba a stand 
alone unit, tdien it madces straddling engagement vith the upper 
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and lower halvw <tf «v paa. on tbs other band, when easaoying 
a cognitive «axlt as the atylos 18 1 the cognitive unit may be 
Qonatructed so as to provide Indida indicating signals to the 
logic unit 82 of the awltl-aedal device 10 via either on 
5 electrically condocUve line or bass (repcesentad fcy line 20 lit 
?igure l)r or BT signals, m suitable cognitive unit can be 
onplcyed as the stylus 18 of the aultl-nodal device lO.iypiesl 
efi sBcb a cognitive unit is the code generating and receiving 
«pparetus disclosed In of U.S. PatMJt Noj 3,635,453. 

10 The code generating agparatus of U.S. Patent SO. 

3,835,453, the disolosiire of which is hereby expressly 
iMorporated by reiertnce, is constructed suCh that a writing 
or narking can be inade on the upper surface 132 of the 
relational input pads of the joulti-Bodal device 10 so as to 

15 provide the logic unit 82 with input pulses indicative p£ the 
location where the marking was aecompllahedi and the appa^tas 
simultaneously generates: an*, t«osnits- :iad*els indlcatiftg- - • 
signals to the logic unit 82 of the TBulti-nodal device 10. The 
Indicia indicating signals transniitted to the logic unit 82 are 

20 in the form of an indicia code representing the matlced indicia. 
In the use of prior art systeSB empl<>yin3 a cognitive 
unit, problons have been encountered in that the ssfstea nay not 
recognise the charaetermade by the oognltive unlt.-Oponr 
eoD^letlon of Jaarking on an input pad of a relational section, 

2S . the activate pad 70 fflar/ be activated, thereby providing input 
inpulses to. the. logic unit 82 that jsoognition ot.the. indicia - 
code nay be started, in the event <rf non-recognition of the 
indicia indicating signals fim the code generating apparatus 
by the' logic unit 82 of the nnilti-aodal device 10, the operator 

30 contacts the code generating apparatus with the appropriate 
Input pad of a predetermined non-relational section so that .. 
data. represented ly «*e activation of .the. input- pad^is-entersd-^ 
into the logic unit 82 to correspond to the narked indicia 
\Aich was mlsreeognlzed. 

35 Referring now to Figure SA, a second embodiment of a 

multi-nodal device 210 is Illustrated. The nulti-modal device 
210 ccBprisss a housing 212 having ao upper side 214. a. 
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plurality of noft^telftticH^ lo^t pads 216 , 218 and 220 aare 
alsposed in peedetetniAed pactins a£ tfaa i^per aide 214 of the 
housing 212 and ^oa nQft-rftlati<»ial saetionff 222, 224 and 22S# 
ceapeetlvdly. Sisdlarlyf a ^uxall^ pC relational Input pads 
5 228 are diapOMd on the tq?per aida 214 o£ tha tonaing 212 and 
form a relational section 230 » The nonr^ralational In^^t pads 
216, 218 and 220, Which define t^e noiwrelational seotlons 222 » 
224 and 226 of the onxltiHBOdal devloe 210, QOn aotivatlon by 
contact with a starlns 232, pcovlde delected control and data 
10 input signals to the logic tmit. 82 of the iBolti-iobdal device* 
210 and thus to a naster con^ter 12 (sfaOMi in Figure 1}; 
^ereas tiie celatlCHial input pads 228 whioh define tiie 
. relational section 230 of the isolti-iaodal device 210, v«on 
activatim bf naiddng engagement of the stains 232, pEovide 
15 locatioa data to the logic unit 82 of the aialti-i&odal dtevice 
210 and thus to tte ffiaster coapu ter 12* the input pads 228 of 
the relatlwial section 230 are interconneoted in rows ax^ 
columns such tiiat location data input is transmitted to the 
logic unit 82 in the nulti^modal device 210 fcr processing as 
20 hereto£<>ra dracribed nith reference to the nolti-iaDdal device 
10. 

The stylus 232, shown in figure 5C, Includes an elongated 
housing 234 ^hich may be gripped by tha human fingers and a 
centrally disposed core 236 having a first end 238 and an 
25 opposed secoid end 240*. Ibe stilus 232 can be an indep^cdent 
. . element, or- stylus 232 «can-lDe -d«ctricaiay-«nn6ot«d to- «se^ 
logic unit .82 of the aulti-^modal device 210 » For example, an 
electrically conductive line or el^ent 242 can be en^ioyed to 
Interconnect the second end 240 of the core 236 of the stilus 
30 232 to the logic unit 82 via-th4 housing 212 of the- multi-nodal 
device 210 so that an electrical potential can he' established 
ther^tsffsen. 

The first end 238 of the core 236 extends outwardly from 
the ^ongated housing 234 of the stylus 232 and forms a tip 
35 portion.. The core 236 can be formed of a material capable of * 
making a visible marSdng oa the relational Input pads 
contacted, or be constructed of a iwrnarSdag material* A 
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t^leal exaq?l» of « aatcorial saltable £or use as tte core 236 
o£ the atylaa 232, is cajiable ofi making a visible narJc on 

the relatiooal input paas^ is carbony whereas an exan^le of. an 
iKawnarking material yhlch can be eaplqyea as tte oore 236 of 
S ti)& s^lus 232 is a steel xDd. 

The noia^nodal device 210 farther cooprises a visual 
display 244, a spealcer 24« and an activate pad 248* The visual 
display 244 and tt» ^aker 24« are enployed to provide visual 
and sovma sianals for poaltive and/or nagativfr reinfiorcanent to 

10 the operator of the nsultl-aodal device 210 in the saae maimer 
heretofore desoribed with reference to the molti-aodal device 
10. The activate pad 248, lAioh iflpon activation pcodooes a 
signal to the logic unit 82 contained In the housing 212 of the 
multi-nodal device 210 so that tiie logic unit 82 cm receive 

15 and recognize the stg^lua signals, is elfflilar in constmcUon 
and function to the activate pad 70 of the nulti-nodal device 

10 heretofore- desctibsd- in-i3etBiK -ttrorefocer,-^ 

description <tf the visual dlsjilay 244, the apeakee 246 or the 
activate pad 248 is believed nacessary. 

20 The multi-modal device 210, In addition to the logic unit 

82 farther con^rlses a pot«r eouroe 80 aad a neoory unit 84, 
each of ^UA is identical In conatruetion and function to the 

. pe«er source 80-, -the ioglOTurirf flZ andrthe nanory un*tr«4 ofi-'- 

the aultl-aodal dwioa 10 heretofore described In detail with 

25 reSarenee to Figure l. Therefore, a detailed description of 

such cQwgonetit&j4tb.jee|!ereiwe.,^the<mati= fflo^^ ilevifti^ ? . 1 0.^ a v? 

would be redundant and is not believed necessary for one to 
fully understand the construction and operation ot Oar '■ 
fflulti-'modal device 210. 

30 Beferring now to Figure 5A and SB, the nultl-modal device 

210 further eamprlaes.a plurall^- of-o«^erletf-aeiibers..25ar (only 

one being llliisferated.rlnf'igure.SBi.ieach^-ae^oaenl^ -msiribers --^^^^ 

250 having predaterminad Qpeninga 2S2 therein so that a 
selected portion of the Input padn 228 defining the relational 
35 aection 230 of th* maltl-Bodal dafvlce 210 can be selectivaly 
exposed to the operator via the openings 252 whUe the 
remaining input pade 228 are covered by the overlay member 250 
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and thus not available to t±e operator as long as the overlap 
xnenbK 230 is malntaiMd in position m the vspar side 214 of 
the hooaing 212* 90t exaople, the overlap noiiber 2S0 d^ploted 
in Figure SB ia 9co7ldea vitb a ploxallty oE opttiinga 232 in an 
S 0ppce^iate looation so. that ^dsen the orverl^ laesdxx 2S0 is 
positioned m the t^pet side 214 o£ the housing 212 the input 
pads 228 o£ the relational section 230 definii^ an ■'add" 
ftsnction of the inulti-*]SDdal device 210 are po sit io n ed within 
the opening 252« By the use of a different nadt, the sane 

10 relational pads ib^ be used Sor perfonBiiig other fopotlona, the 
naak pocwidlng ti^e vlndov fqr selectively exposing and bringing 
into zelational positioning the "free fam"* pads fen: 
aecoflrpllshing the desired £uncti»« While the overly mesabet 
2S0 has been illtistrated as cmtaining a pluralit? of openings 

IS 252» it ia readily apparent that the overlay menber 250 oan be 
provided a alngle opening of a peedetemined else and shape 
required to expose the 'pres^ected input pads 228 of the 
relational aeetion 230 defining a parti'oular Sanction* 

She overlay member 2S0 can be fiomed of any suitable 

20 mt^ialr &i9tfever/ It is preferable that tte oveirlay a^iber 
250 be formed of a thin sheet <tf durable^ flexible aiaterial so 
tiiat the overlay neobet 250 can be uaed a nmsber of times, 
rcbas, desirably the overlcty material will be. formed of a 
plastic or heavy duty paper material. 

25 iiumercua methods can be.^tplcyed to secure the. overlay 

. mei^ 250-^ a -8tabay-pogttion-oo--thr up pe r s ldtf " I ir^9f"ttei * 

housing 212 to insure that tiie prpper input pads 228 are 
exposed via the openings 252 formed In the overlay meniber 250. 
The particular method employed will be dependentr to a large 

30 degteer i^n Aether the ingut^^ads 228 of the relational 

section 230 are substantially flush with the i^per side 214 of « 
the bousing 212f as abown in Figure 5&r or aore in a raised 
poaitim above the upper side 214,. as ehow in Figure 5ft, 
ridge assembly 254 is disposed on the upper aide 214 of the 

35 housing 212 so that the ridge assaiOdly 254 eneonpassefr the 
input pads 228 of the relational section 230. OSbe ridge 
assCTbly 254 can be a continuous segmantr as shorn, 'Or can be a 
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plurality o£ Internittant segments disposed around the 
perlptaety o£ the relational seotion 230 » 

The process o£ li^e»eiitisg the multl'nodal davloes 10 and 
210 are substantially Identical. Thusr tiie ptocess of 
5 implementing the multi-modal device- 19 will he described in 
aore detaU with refetenoe to Figures €-10 of the drawings. 

Figure 6 lllastrates a process 300 fas seXecting the 
vadous foDfetioas that are available on tita miltl-oodal device 
10. Xn oarrylBg out tiie process a sequence of steps and 

10 decisions are required, the first step requires a decision of 
whether ornot to transmit or receive data or control signals 
ffon the host or master oonputer as shown in hlodc 302. If a. 
'yes- deoislon Is made at this particular point. Mode 304 Is 
invtiked which will either allow t±& transmission or receipt of 

15 data and/or control signals te/ftwai the host computer means 
previously described herein* If a "no" decision is made, one 
of the four functions represented by block 306 ia saleated by 
activation of the aeprapKxtAB iRPUt pada. 0» particular 
seleetto m^ be made to proceed to a "define*, -solve", -pliy- 

20 or "Show me- node.. She next decision ia to determine whether 
or not to -reset*, in the event that an eeroaeoufl signal has 
been entered. The -reset" la represented by block 308. If 
•reset- is selected a signal Is fed to connector "A", 
represented by Mock 310, and the selection process is 

25 restarted ficoo the Isput oonnector "A". On the other band, if 
• thereaet 18 notaotl-vatea-a»4gnaa--te-dirB«sa^ 

£6r a determination as to the validity of the selection. If a 
valid -selection has not been made, a signal representing an 
error message would be produced In Mock 3U and- a signal 

30 directed to connector point -A-, Mock 310, to restart the 

procedure. l£ a "cocraot- selection has been made a signal is 
directed to one of fisur poaalMe connector "B-, -C-, "D- or 
•B-r represented by the blocks 316, 318, 320 and 322, 
respectively, whereupon the signal would proceed to one of the 

35 following blocks, naBSly? a •define- Modt 324, a "solve- 
Mock 326, a: "play" Mock 328, or a "show- me- Mode 330. 

Figure 7 illustrates tte "def ine» function of Figure 6 and 
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the procedures Involved therein, Tbe ""define" fttnction is 
aoooD^lidbed vta signal inQut tliroii^ eonneotor "B* r^reeented 
fey the block 316» The "define* function is repcesented bsr the 
block 324 and In ppemtioi. the operator decides vftoit to do 
5 within that function,. Block 327 provides for the aelectioi of 
the following; 1) math pro&leos, 2) gelling, or 3} oaslc. 
Open selection o£ oaoe of the above functions die pcocess allcm 
tixe pp^ator one of tm options at blodc 329, either to ''reset" 
or to proceed to the next part of the pcocees, the ev»t of 

10 "reset" is selected, a eiqo$l is directed to connector "A", 
block 310* If not 'reset", a signal pcocasds to a valid 
selection blodc represented hy tbe numeral 313 «tiere a 
deternlnatlon is made vtiethn tbe signal repEosents a valid 
selection. Zf tihe signal represents an incsorrect selection the 

1^ Operator is given an error ^oeeaage represented bf block 315, 
and the signal would proceed to connector "B" , block 316 and 
tbe process would be cepeatsd. If tbe signal re^cssents a 
valid selection tbe signal proceeds to> one of tteee oomeotors 
"F"r "G", or "B"r represented faf the blociieB 331, 332 and 334, 

20 respectively. These blocks allow the poeooess l^ien to continue, 
In the case of connector '^", block 331, to inatheoatical 
cperationa represented by Ucck 336; in the case of connector 
*6", block 332 to spelling operations r^esented bj block 338; 
or In the case of connector "H", bloeSc 334, to aoisic operations 

25 represented b;..blockT34&^'^tlpon-seleoti€a--o£ ^one- i^-*tbe* threes* 
possibilities, i«e* Vtatb, spelling or noslc, an pption to reset 
is provided r^esented 1^ block 342 to allow for reaelectiOn 
IC needed » I£ the reset function .is not involved, tbe process 
proceeds to block 344 for data input and then onto block 346, a 

30 valid entry decision block. If an invalid entry was made, the 
signal would oontintte to block 348 wberrapm an error message 
would be produced and tiie signal would proceed back to tiie 
connector °G", or "K* depending i^on ^Aere the process 
originated fscm» If a valid entry was loade, the signal would 

35 continue onto block 350 where a determination would be made as 
to whether or not a definition had been coiapleted. If the 
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definltion had not been ctaapletea, additional li^t ot data la 
entered hg tepeatina'the Brocase throajTh hlodk 344. If the 
^inMm badi baw ocmpleted, the pcooess would stow the 
definition of the problen in the block repreaeated by the 
5 wneral 352. ojwn storage of the definition of the pcoblem, 
the prooesa would be repeated through lAiChever oonneotoc the 
proeofia atarted until the definitioo jaMeeae 1« oca^etad. As 
detailed .hereinabove, coaneotor starta eat exao^e of a 
nathenBtical problem defialtioii procese. The procedure ^«>uld 

10 be fiollowed In the same manner in each of the thr»e hlodts 
whether it was connector "F"^ for natbr conneotor "6* for 
apelling, or conneotor *B* for naic. 

ibe solve function flow process of the jnalti-wbdal device 
10 16 llluatrated In Figure. «. to input algnal ia received 

15 through connector »C», repreaented by block 318, and the aignal 
is dlreptad to solve taodt 326, in this instance one of five 
possible ftmctioaa repreaented by block 358, nairely, add, 
subtract, Bultiply, divide or apelllng way seleoted. open 
aeleetlon of one of the five fonctiona, an oppcrtani^ is 

20 pcoTlded to "reaef if an emw has been made. Bie "reset- ia 
represented ty bloc* 360. When it is deteraiiied that an inpit 
exror has been oiade, and the' reset activated, » signal is 
directed to the conneotor "A" represented by the blook 310. If 
the input is proper, the signal is continued to blodc 362 for 

25. determination o£ whether the signal represents a valid 

..aeleotlflo. iwovOceuranceateai^ppeD-'^^H^odr^ 

.selection was invalid, a signal is produced to generate an 
error message, represented by block 364, and the signal would 
proceed through conneotor i.e., block 318. On the other 

30 tend, if the selection was correct, a aignal la provided to one 
off five selected functions, namely add, aubstract, multiply, 
divide or spelling, represented ty-tttS-bloOks 366,-368? "STOT"^ 
372 and 374 via connectors- "I*, "J'f "K"* '^^ ^ 

represented, by blocks 376, 378, 380, 382 and 384, respectively. 

35 Dpon selection of ajy one of tiiese five functions & 

determination as to whether or not a "reset" is neceaaaxy, and 
In the event of an Input error, the selection can be reset via 
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xe^et hlodc 386^ If "vea^t'', a signal is passed to conneotor 
«C'/ represented fay ttte blocdc 318 no that anotbsr selection, 
could be aadc. Fbr ezaoQler if doing en odd function and the 
snbtsaot fonctioa loas li^t, tto prooese eonid be "reset* and 
5 the correct add function input* X£ tbe correct £uRct»»i has 
been iz^t, and tbe process not "^^t'r a signal Is directed 
to block 389 for input of data; and tb^ into blodc 390 wbers a 
determination of tbe validity of tbe entrjr.ie laade* Z£ tibe 
mtr? ie tavalid, a. signal is directed bo Uodc 392 tdtere an 

10 error message is produced/ and tbe signal representing tbe 
error isessage is directed bacOc to block 388 so tbat osv data 
can be input, Oifae signal representing tbe new input data would 
again be directed to block 390 for determination as to lAetber 
or not a v]alid mtry bad been made. In tibe evmt tbat an entry 

IS vas valid/ a signal representing iiie valid entry v^d continue 
to block 394 ^ere a determination would be made as to vbetber 
or wt the solution was conglete^ If tiie solution is not 
conqpleter in tbat tbe solution required more stepS/ a signal 
would be passed bade to block 388 for input of additional data* 

20 i£ tbe solution is conqpleted/ a signal la generated i4iich is 
passed to block 396 trtiere tbe signal representing tbe answer is 
evaluated witb stored &ta to determine wbether or not it was 
correct* !Che process would continue by providing. a signal from 
block 396 to .tbe connector from wbieb t±ie process originated # 

25 sQdi as the connector *Z' if the "^add" ^moticn being 
processed* . tbe^above- described'-pi^ffoees -^x^^ 
ansr one of the five possible functi^tsr namely add/ subtract^ 
multiply^ divide or spelling* 

Figure 9 Illustrates a flow diagram of the 'pl^" mode of 

30 the multi-modal device 10 «i A signal, representative of tbe 
''play'* mode is entered in connector "D* represented lesj tbe 
block 320 and passed to tbe **play' sode*ilep9;etent^*by bltifak" 
328. From block 328 tbe ^gnal Is directed to block 404 vhere 
a decision is made b/ tbe operator to play music or a game« 

35 Once the proper selection of the '•play" mode has been made, a 
signal representative of tbe. selection is passed to block 406* 
At thi& time tbe operator determines wbether to reset, the 
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process or CGntinue an* Zf tte procesd- is reset baoause th& 
operator does not wish to proceed, a algnal is gmeratad via 
block 406 and directed to oranectdr "a^, represented by the 
blocic 310^ l£ the process. ims not resets a algsal Is advanced 
to blodc 408 where the signal is cmpated to detamina if a 
valid selection was loade. l£ the input signal is detemlned. to 
be inoorrectr the signal representing eoob a detenoinatlon is 
8i;VPii^ blodc 410 idkere a signal t^rese n ti ng an e rr o r asasage 
is produced and fed connector "D", represented by the hlodc 
320* If the atgnal received by the block 408 represents, a 
veatd selectlonr a signal is generated and directed to either 
blodc 412 via connector represented by the bZook: 414 cor to 
block 416 via connector represented by the blodc 420. 
Connector "N*^ is used for nttislo selection as sboiin 
412? and connector "O" is used for game selection as shown 
block 416. If the operator bad selected the nusic mode, the 
operator would have the option to either continue or "reset" by 
activation of a reset wcbanism repcesmted by block 420 so as 
to provide a signal to connector "D* , repres&ited by the block 
320* If "reset" was not necessacy a signal would be passed 
from block 420 to a "play music" block 422, whereupon the 
jtwlti-'ntodal device 10 would play music ► l£ the selection had 
been Blade to play a game, a signal would proceed Eron connector 
•0", represented by block 420, to the gafoe block 416, vHere^on 
the (^erator could suOce the selection to either continue or 
reset by Estivation 'ofnaTre%&'Tfieta$aMfito^ ' 
block 424 so as to provide a signal to connector "D" 
represented by the block 320* If the "reset" had not been 
selected a signal would be passed from block 424 to a "pl£qr 
game* blotic 426 wherein ^ nulti-^modal device 10 would play 
a game as preselected* * In either of the above selections the 
device 10 would either play noiaic or play a game and would 
continue until the cQmpletion of the music or the gaioe, 
whereupon it could be "reset" and go to connector "0"* 
represented by block 320, or continue to play other nusic, 
tunes or gaoies^ 

Figure 10. is a flow diagram phowing the *sbov ne*^ function 
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o£ multi^sDodal device 10. Tbe "sfaour lae*- fiocnctiOA Is enterea 
via a signal thxougb ooxmeatsae "B^, repcesmtedl fajf block 322 
idtereuEon tbe signal ptocsesds to the ^Om bloc3t 330. Zbs 
ppecator has tbe possibility of selecting one of several 
5 . possible* functions represented by block 434/ sudt as a aoaution 
functicxir a score functionf oc a jnathematical tables fiinction* 
ppon making a seleotitm of one of tiie tbree above fianctions a 
signal is generated aid tte cp«ator most detundne wbetber to 
activate a reset laechanisft r^res^ted bg' blode 43€ or continue 

10 on* Z£ the xeset nechanism is activated a signal is directed 
to connector "A*r represented bjr the noneral 310 • If reset is 
not necessaryr a signal feom the block 43S is passed to a valid 
selection blodk 438, In the event an invalid selection is made 
a signal is directed to an error iDS^age blotdc 440 nfytteasm a 

15 aignal representing an error message would be produced and 
passed to connector "E" represented fay ^ block 322« I£ a 
valid selection is detained by tte block 43$ the signal is 
passed to either a solutions block 442 via ccmneotor "P" 
represented by the block 444#. score block 446 via connector *Q' 

20 rqooresented tbe block .448, or tables block 450 via oonneotor 
represented by the block 452« for exansple, if the solution 
function had been selected and the input signal been 
detexDined to be a valid signal^ the signal muld be passed 
through the conaector *F*f i«e« blocik 444 and fros there to tiie 

25 ' solution block 442. The signal srould then proceed to a show 
. solution block-454. -where .'A.^8ponse--«e^-te'>Sen« 

tte solution to the probl^n that was. being ^ked on. Upon 
conpletion of the "show solution" fcnction tiie process would 
pcQc^ to connector 'E"" represented by the block 322 ^ 

30 similarly^ if Mie ^score" function' had been diosen tlie signal' 
would continue froe connector *Q*f represented by blodc 448 to 
. the ''score" block'446« ' At tibat tba^r'the sigxial would- continue 
to tbe ahcv score blo^ 4SS» Opon ccsspletian of the score 
being dhown ty the multi-ioodal device 10 a signal continues to 

3S connector represented by block 322 for further processing. 
In like manner if the "tables* block 450 has been selected, a 
signal would continue to connector "R"*, represented hy the 
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block 452 and contlnua onto th» "tables" block 4S0. B» signal 
would then pass to blodc 458 £or selection o£ a proper 
ptepiograaed table. A signal representing the proper table 
would be transmitted to the Show table blodc 460 lAerwipon the 
5 table would be transfOansa into a- fiotw suitable for use and 
inspeotion bjr the operator, opon cca^letioft of the tables 
being shown, » signal would be transmitted to connector "B- , 
r^cesented by block 322 for the contiitaation of processing, 
the general operation of the oulti-aodal education and 
10 entertainment device 10 will be described hereinbelow. Hhen 
power is turned on, the nultirnodal device 10, through its 
stored program shows a BBssage on the displajf proropting the 
user to choose one of the control functions. For Instance, in 
one form, the following aay he the options - define problems, 
15 solve pcoblema, spell, play music or play games, it any choice 
other than tiiose abom edsove is made, t4» program provides an 
error feedback and re-prompts the user fior -the correct choioe. 

Assuma ^t "solve" option is selected to solve problens 
previously defined. The program pron^ta the user to select one 
of the followingi add, subtract^ multiply, divide or ^1. 
contacting any other pad location ptcnpts an erta: message. 

NOW assume that the sQrlo* » wm-cogj»itiVB element, is 
noved across the two half pads- of the *add- contrttl input pad, 
thereby selecting the add function. Ohs program now- prompts 
25 the user fOr the first "add- problem to be solved. The subject 
: first writes, the. problem JoxJat^-soi^^ .a5^,tbe.xelatioaal..^ads-Jiv, 
the "add* relational section, such a* data input pads 46 of the 
relational section 56. Brferlug to Figure to, this is dwe as 
follows! in the single entry node, the stylus 18 is first used 
30 to mark the digit on the appropriate relational pad, thereby 
Indicating the pad location being marked on, followed 
immediately by moving the stylus 18 in. an electrically 
contacting position across the two half pad* of the appropriate 
cognition pad (data input) 38 In the non-reXetional section 44, 
35 this procedure informs the logic unit 82 what digit, (value) was 
entered in the previous operation. In the multiple- entry mode^ 
several pads- in the "add"^ relational section are written oor 



20 
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then the stilus 18 is novBd «csoss the two halves of the pads 
o£ the on^xspriate dtgitta) in the date input pad 38 in the 
lUHi«relattonal seoticsn 44; tbe ssidb nvniber oE tiiBBs and the * 
sooe seqo^ice-as loriting vaa done In the earlier c^«raticn. ' 
5 !ihls process is continued until the probl«a is solved, ht this 
tine the nor^relational control input pad 'enter' is contacted 
across the two halves, thereby infisonolng the logic unit 82 that 
the sctbject*s solttticsi is read; to be scored. The logic ooii: 
82r tfarou^ its stored prograats), solves' the prcblea'and 
10 dtiedcs the sbli^tion against What the subject entered. If It is 
correct, the program adds 1 to the good score ion ^^add' s adds 
1 to the total add prcA>l^ solved. This is followed by a 
visoal and/or sound displv o£ a "good" mewage feedback, the 
ptocess then presents the next *add* pcobleza for eolation as 
15 before, ^neeverr if the sdloticn vas in error, a visual aiO/os 
sound error message is displayed, and the same problem is 
presented for retry. Howevw, the program adds 1 to the total 
att^Qpted for problema thereby lowering the subject's 
earned score (percentage) for "add"« 
20 i<he subject may do one or more of tiie fioUowlngi 

1« By selecting tba sldp control function, request that 
the present problem be 8kiEf)ed and be presented with 
the next problem. 
2. By selecting the "score" control function r request 
25 the score to be displ^r^d to this point. 

3« By- selecting U»e- ^pronq^** -osntiKiil- function r^the -« - 

y jcogr aa <^cks the validly of the prcblom as it 
is being solvedi providing a viaual and/or sound 
feedback vhsn an error is detected. ^ 
30 4. fiy activating the "Shov He" pad followed fay the 

^'Answer* pad, the solution to the problem is , 
displayed. Once the "Answer* is selected, the " 
process can be such that the subject cannot get a 
score on that problss. 
33 The process herein above described shows problems m^be 

solved by means of the '^add* mode as an illustration. The 
process is similar for subtract, multiply and divide. 
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Hben the *60lve<' oontsol £uiiPCtoi^ is followed bsr tbe 
^spell" control functi^r the logic, unit 82 pioto tha first 
word defined for spelling, and through the voice s^tithesizer, 
convortft it to sound isipulfles, Tbe subject then spells tbe 
5 mrds lay writing on the "spelling" pads 54 In the relational 
section 64 followed bj moving tike* wlting nediom across the two 
halves of tbe data input pads 38 to the novHrelational section 
44 in the sante s^ence as In which the letters were written on 
the spelling pads. When the spelling has be^ accco^lisbed, 
10 the Center* control function Is selected. As in the case of 
mthi the logic unit B2 checUcs what was entered against the 
defined itord.for correctness and scoring* 

Tbe nnilti<*inodal dendce 10 has provisions for defining 
problems through itself, ag^xt froa the master oon^iater X2. 
13 This feature ^ivea the parent/guardian of a child thepption to 
define problems more suited to the needs of a child* Prohl^ 
definitions are daily soconpllshed as follows 

First the stilus 18 is ocwtactingly ocved across the ta«> 
halves of the input pad labelled ''define'' to select the define 
20 mode. 

Assume that the fi^llowing two numbers are^ xeguired to be " ' 
added! 427 4- 608. The stylus 18 is contactually moved, across 
the twp halves of the data input pads 38 in th& non-relational 
section 44 labeled with the digits, and eyaitolB in the sane 
25 sequence as tbe sequence shown. The process is teminated by 
aotlvltlng the.^^^ter^-padr^whicb^rsign^^^tbe^^ 
store the defined problem for future retrieval and use» This 
la very easily and sisiply accosnplished*. 

The method of defining other types of problems i.e. 
30 subtract^ multiply and divide^ U similar to that for the ^add^ 
mode. These are si3i5>ly done- by writing the problems* Stf a" " 
string with tbe operator i +, *r iobedded within th^ 

string as shown herein above for *add* and entered as described 
for "add^ fb» logic unit 82 stores tbe problar defined in Its 
35 msmory unit 22 for future use* The defining of words f6r 
spelling is accomplisfaed in a siioilar manner. Eowever, after 
choosing the •define' control option^ the "speH* control 
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qptioD loay be selected to InCbxm the logic unit 82 tbat 



In a aiallar fUhion, mufilcal aoores may be SeCioed. She 
note to be pLagea followed the tine duration eoce written as 
a string, lbs define control funotion is first dioeen^ 
fallowed by the "niusic" control function. She stylus 18 is 
then moved across the apprq^iate data input pads 38 in the 
non^relatlon section 44. in the same $e^ence aa tiie string 
established* 73» logic unit 82 then stores tbese values in its 
inemorjr 84 for ftoture retrieval for producing the tune. 

She flttUti-iitodal device 10 al80 has provisions for a Child 
to play games, ^s is done by selecting the game tsption 
folloved by the game control functions*. Xhe logic unit 82 is 
programmed to profl^t one or more subjects through the games. 
Ifasse ncff be# for instanesi pl^jfing word guessing gamesf number 
guessing games ^ tio-tae-toe etc* • 

fFhe function of one other set of pads needs to be 
described* These are tuo vertical sets of pads 36 co m prising 
the noi^relational section 42. These are provided as a means 
to have feedbadc for verification purposes. For instance^ tdien 
solving an add ^^bblem, activating the pad narksd 14/15 
disple^ the carry digits stored In the memocy unit 84 which 
can be visually verified against what is written on the carry 
pads. Any discrepancy noted can then be corrected* T»o 
vertical rows are provided because of the fact that only eight 
display dhi^Qtm^'xe^i&issta;^^ 

shown* Activating one of . the "left dlqplay pads" 36 will 
display up bo eight characters/numbers in the same row to the 
right of it? activating one of the "right displ^ pads* 36 will 
display op to eight characters/numbers in the same row to the 
left of it*. ' 

tests and hcmework assignments In a classroom situation 
using the present Invention are carried out as follows; ^ 
teacher defines the problems or assignments to be worked on by 
the children in the master cc^uter 12« Through predefined ' 
communication procedures between the master cos^ter 12 and the 
multimodal devices 10 or. 210 connected to it through buss 14, 



spelling words are to be defined* 
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tbe igccbleas or wsignnents ara 'shipped down'^ to the 
individual umlti-Qodal deviGes 10 or 210 where they ace stored 
in tbd iii^&oi^ Wit 84 (shown In Figures 3). Bach child is then 
dble to retrieve and solve the proUesBs as previously defined* 
S In the event the children are being teetedf at the 

expiration o£ the appropriate length. of tixae, the teacher can 
'pull in* tise test scorea £rci^ eadi o£ the aulti^tnodal devices 
10 or 2X0 into the na^teir conputer 12 £or ta bu ] a t Ion and 
storage^. 

10 In the event the children are solving home-worJc problems ^ 

the pr^w 'ahlj^ed down** to the nualti-nodal devices 10 or 
210 £rom the master o^iQuter 12 are stored in the nemor; 
portion oS the mencNry unit 84*. At the end of the «V# the 
dkildren disconnect buss 14 from the multi--modal devicee 10 or 

13 210, carry it home and solve the assignments. The next day, 
^en the multi'^modal devices 10 or 210 are ejected to buse 14 
end thereby to the master computer I2r the score for each chil4 
can be "pulled in" as before*. 

Ibe libove ^cocess redueee the time required fay teachers to 

20 (JO routine dioreB of grading peepers and other tiw cpnaijoaing 
book keeping taste* Axis vill free up tijee m Hx^ part of 
teachers that laav be fruitfully used Iqk providing personal 
attention to children that need help* 

Zt la clear that toe present invention is veil adapted to 

25 carry out the objects and attain the mSB and advoitagee 
.mentloned:.as well ^ 'ls^&4f6siB£A^ 

preferred eznbodlment of the invention has been described for 
purposes of this disclosure^ numerous changes may be made which 
vill readily suggest tbesaselves to those slcilled in the- art «d 
30 which are encooipassiBd within the spirit of the invention 
disclosed and as: defined in' the following clalins* 
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Khat is dalBed id? 

.1. An iisproved moltl-inodal antonated edaoatlooal and 
entartalixmsnt devlca coaprlalogt 
a housingi 

logic oeans for pEDoesain? and OGsparing fee* 
5 progcaniAed data witti iJQUt and contcol data; 

nsoory neana £or atoring prograias and iopxt 
data, tiie nemDzy meana being operably 
connected to the logic ineana» 
a pluralil? o£ £irat input nftana foit ps^. 
IQ vidisg. control signals and ptedeflned data 

signals to tba logic veansr tbe first ii^t 
means forming a pluralitsr of noxi-rolatiGnal * 
sections wltbin predefiniftd portions of t&e 
bousiogi and 

IS ' ft pdurali^ of second iwut means for 

. pcoTiding location indication, signals 
rspresantiug the location of variable data, 
tiie secoi^ input iseans forming at least one 
relational section within a predefined portion 
20 . of the hottslng* 

Z« rcbe inipeoved nuilti-^no&al automated educational and 
entertainment device of claim 1 further con^prislng.«a stylus 
aeans for selectively activating the first and second Input 
means. 

3, The iiqproved imilti^-iDOdal automated aduoatlonal and 
ezxtertaiflm^t device of olain 1 further coaiprisix^i 
reinforcement means ogerably connected to 
tte logic means for receiving a signal 
5 representative of the results of the 

oGOiparison c£ the preprogrammed data of the 
logic means and m^nory means with the control 
signalsjr locatifSft indication signals and input 
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data Bocpliea the logic, aeaas vta actlvatloi 
ot ttx^ Orait and second Inpot neansr and 
produetng a relJifoicenent signal. 

4. The ijnpKwea nulti-oodal automatea educational and 
eatertlinment device of claia 2 wh»K«ln the logic means is 
connected to the £iwt and aecond input means via a tirst 
bi-ditectional buss a«d the logic means is ooaneeted to the 
stylus mean* via a second bi-directional buss. 

5 The Improved molti-aodal automated educational and 
entertainment device of elate 3 therein the reinforcement means 
coBprises a voice unit electrically oonneeted to the logic 
neans and adapted tt> receive a signal from the logic means so 
that the voicB unit can convert the signal into an audio -ound 
for positive and negative reinforcement to an operator of the 
device. 

6 The iasroTCd imflti-modal antofflated educational end 
entertain«ent device o£ claim 5 vherein the voice unit further 
ooaprisea a voice synthesiser and a receiver, the voice 
synthesiser pperably connected to the receiver for providing 
audio meaaagea to the operator of the device. 

7 The iaproved multi-modal automated educational and 
. -sntertiinp^*- aevtc» o6*clstm^'«her«4»vt»e^«*^ 

coBprises a tone generator pperably connected to the receiver 
for providing audio signals to the operator of the device. 

8. The iaproced multi-nodal autoaated educational and 
entertainment device- of claim 3- further comprising visual 
displasr means electrically connected-to the^-lo^lem^ansf or"— - 
providing a visual readout of signals transnitted to the visual 
displ^ means fscm the logic means. 

9; The improved nulti-nodal automated educational and 
entertlinment device of claim 8 wherein the visual display 
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means coqpelsas a plurallq^ d£ lights aad alphanumeric liSDa or 

10. ^ ijsprofved nultl^nodal antomated educational and 
entertainmedat device o£ dala 1 therein the logic snean^ is 
provided with an integrated Input/oatput pert, the Inpnt/output 
port electrlcaUy connectable to a master coopiter fidr 
transmission and receipt ot control ahd in^pat/out^t data to 
and fran tiie master computer to the 10|9io means o£ the device. 

11« The inpcoved multi^modal aateooated educational and 
entertainment device o£ claiA 10 wherein a plurality of the 
devices are operably connected to a master computer^ each of 
the devices adapted to transmit and receive oantiol and 
inpat/oui^t data to and from ^ master computer Independent!; 
of eadi other* 

12. The Improved molti^nodal automated educational and 
entertainment device of claim 4 vfaerein the first and second 
iispttt means each comprises a plurali^ of ix^* pads, ea^ of 
tbe pads electrically connected to the logic means su^ that 
upon activation of the pads signals are directed to the logic 
means representing location indication, input and qcxitrol \3atc: ' 

13, Tlie improved multi^-modal automated educational and 
enter.tAin3nent device 0fe.claim,12Lyherein^ch.JLn ga t..pad.is> ^^•w. . 
provided with a body portion having an qpper wrface.and an 
opposed lover surface, the body portion being constructed of an 
electrically conductive material such that upon contacting tiie 
upper surface of the boc[y portion with the electrically 
conducting stylus, electrical signals are transmitted to the 
logic 



14 The improved multi-modal automated educational and 
entertainment device of claim 13 wherein each input pad 
coc^isess 

a body portion constructed of an electri- 
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cally conductive luatarial, the body portion 
having an upper surface and an opposed lower 
surface, the body portion further 
ofaaraoterlzed as having a first half and a 
second half i 
* an insttlatiog. ssdium disposed between the 

first and second halves of the body portion 
such that the first half is elsctrioally 
insulated froni the second half; 
a first oonflttotlye lead electrically oon- 

neoting the first half of the body portion to 
the logic iseansr and 
a second electrically conductive lead 

electrically connecting the second half of the 
body portion to the logic ©eans* 

15» She inpKoved nolti-niodal autoniatea' edocatlonal and 

entertainment device of claim 14 wherein the input pads of the 
second Input niaans foniiing the «lational section of the device 
are further characterized as having a scribing surface foraed 
on the upper surface of the first and second halves of- the bo^- • 
poftion audi that visible narkinga may be made thereon with the- 
stylua and may bar easily erased* for rrasr." 

16, The improved multi-nodal autortated educational and 
.mejctainBieirt:.:devica Q&^qdn^l3^egfein-.itbe,:^a^^ 

seomd input means ftemlng the relatival section of the device 
are further characteriaed as having a scribing aorf ace formed 
on the upper surface of the body portion such that visible 
marJdng.may be made thereon with the stylus and may be easily 
erased for reuse. 

17. The iinprov^ muItl-ODdal autonated educatiwal and 
entertainment device of claim If wherein each of the first and 
second input means comprises^ 

at least switch means for providing an 

Input signal to the logic meanSr the^ switch 
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meam teing activated b7 the st^lQS neana aad 
the lapat signal pscoduaed thdrebjr being 
indicative oe tte apeolf le swltxb mans being 
aetlvatad, 

18* She Is^Tovea miilti^isndai aatom&ted educational atid 
enteirtalmnent device cf claim. 1$ lAiereln eacb of the first and 
second ias^t means copprlsest 

at least. -one eleotrteally oanduotlve means 
S for papoviding an input signal to tbe logic 

meansf the electrically oonductiye means being 
activated by the s^lus being bcought into 
electrical conduotion vith a selected one of 
tbe first and seeottd inipixt pieans and the ii^t 
10 signal produced thereiqr being indicative of 

tike specific electrically conductive means 
being activated,. 

19* Olbe iiQproved maltl-^modal automated educational and 
entertalnsent device of <daim 14 idiereln the first half of tbe 
pads of tbe second ii^t means forming i±e relatival section 
are preccdedr tbe first halves of the pads bearing the same 
5 code being electrically connected together to form rovs of 
pads^ and wherein tbe second half of the pads of t&e second 
Input means fiorming the relational section are preceded^ th9 
second halves of tike pads bearfiQ i±^8Sm€*C0ate''b61ng* ' ' ' 
electrically connected together to fcxm columns of pads such 
10 that upm contacting the first and second halves of a pad vith 
the st^rlusr input in^se signals are transmitted to the logic 
means representative of the row and column location of the pad 
such ttot tbe logic means throu^ stored programs can ldentl|y 
the- specific pad lb»ticSr' 

20. ^Ihe improved multi-^ioodal autooated educational and 
entertalnsent device of claim 14 wherein the first half of the 
pads of the first input means forming the non-relational 
section are preceded » the first halves of ti» pads bearing the 
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S s«ne ooda being electrically eoaneeted tagethev to form rows of 
pads; and therein tte second half of the pads of th» first 
Input BBana fiownlng the nowwlatiooal sectlOT are pceooded, 
the second halves of the pads bearing the san» code being 
electrically creinected together to form adunns.of pads such 
that iipon contacting the first and second halves of a pad with 
the s^lus# input Inpulse algoals da» transmitted to the logic 
aeans representative of the row and oolunm. location of the pad 
such that the logic means, through stored programs can identic 
the specific pad location. 

21. iiivroved nultiraodal antooated educational and • 
entsrtalnnent device o£ claim I further coaprising scratch pad 
TOff "" disposed on the upper surface of the housing for allowing 
the operater of ^ device to scribe thareair information 
Ireful in the operation o£ the device. 

22. The iJifncoyed nolti-iDodal autcniated educational and 
entertainment device of daim 2 i«hBrein the stylus means ie 
used to m&. indicia on tie second ii«ut means, and ;rtierein the 
s^lus means is further cbaraoteriaed as cfflq^isingi 

cognitive hems for providing indicia 

indicating signals to tb» logic means for 
deciphering the marked indicia* 

23 e Tha taprovea inaltiHinodai^'afltanatea • edacaticaial^and 
eatertainaent devloe o£ claim I i«herein at least oi» of the 
second input toeans is characterized as comprising: 
cognitive inaans for providing indicia 

indicating signals responsive^ to indicia 
marked on the seccmd input meana, the indicia 
indicating signal a provided to the logic niaans 
for deciphering the marked indlciae 

24. Bje iifiproved ittulti-oodal automated educational and 
entettaininent device of clala 1 further comprisings 
power neanff for activating the logic nean? 



PAGE44l74'RCVDAT8126l200S9:42;26PM|EasteniDa^^ 



Aug. 26. 2005 6:5)PM Vierra Magen LLP 



No. 3546 P. 45 



WO 84^995 • Kvmmi» 

-36*^ 



into an operable siode^ • 

2S, *Che isproved sultl-sodal autooiated edacatioiial and 
Mtertalnnent device oC (dalm 1 £urt2i0r cooprlalngt 
overlay means poi^itlaRable oa Mae housing 

for defining a aeleoted portion of the eeeoi^ 
S input iDeatt9» 

26. Ihia iiaproved nulti-ioodal automated edoGational and 
entsrtainnent deviea of clzin 23 farther cod^rlslng: 
ororlay means positionable on tiie housing 

for defining a selected portion of the second 
5 input neansr the overlay means having at least 

one opening fbstodd tfaerein for ea^psing the 
selected portlcm of the second input means* 
poaitlming means Sar positioning the 

overlay means in a stable position on the 
10 housing*^ 

27« The inproved multl^modal automated educational and 
entertainment device of claim 2 ^rein the stylus means 
ocmprises: 

a stylus having a body portion and a tip portion 
5 Qupported thereby, the tip portion being ftemed of a 

substance capable of making visual, marking on the 
second luputiTnearoe:^'*^'^- vs:;'** ^ •fcn-^ 

' 28 « The improved molti^modal ^tomated educational and 
entertainment device of claim 2 herein the stylus means 
comprises a stylus having an electrically conductive tip. 

29* The iBipxoved multi-modal automated educational and 
entertainment device of claim 2 wherein the s^lus means 
cos^risea a stylus having an electrically conductive tip^ 
eleeltrically connected to the logic means* 

30, Ibe improved multi^modal automated educational and 
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entertainmant daviee oS cliuM 2 idMrein.the a^lua aieaiis 
eoiqarlsest 

a cognitive stylus capable ci peoducing 
5 indicia indicating signals to the logic means 

via electrioall; condaotivd lines cx SF 
signals* 

31. . An la^woved oaiti*ii»dal aatonated educational and 
entertainmant device of claim I wfterein tbe second input means 
are positioned on the upper surface "of the housing in a 
relational position so as to leJats to the positions of digits 

S in a wM±einatieal peobloit. 

32. an improTOd multi-modal atitOTiated educational and 
entertainment device of claim 1 wherein the second input means 
are positioned on the upper surfeca of the bousing in a 
r^ational position bo as to relate to the positions Of letters 

5 in a gelling word/ptoblai. 

33. JUJ Improved process for information input using 
electromechanical, storage/ control, con^parison, retrieval and 
output devices con^prising the steps of i 

inputting a first input Tsignal* to a logic- 
5 means representing control and pcedef Ined data 

information; and 

• inputting a secen* iseaat^igraitJixi.^tves.togi^ '.si*a»i -^-^^'■^ 
neaos representing location indication 
infioEination, such that the logic, means can 
2^0 proceed in aococdanee ifitb a predesignated 

progran of operations, 

34. The iRcocess of claim 33 further cbwacterized-as" 
ccoQ^eisingi 

producing the first and second input 

signals in a predefined sequence of control 
$ and data input activation. 
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as. The procesft of claim 33 lAtteln tba logic mans ia 
operaUy' connected to a weaoef ineaas having at least ana 
atoraga davlca therevithr and wheraln the second input signal 
haa ^Qpbanuaeric infocmatioo having nattoioatlcal control 
5 indicia Into the stora^ device of ti» meiaor; inaaiia* 

36^ Tbe procesa of daim 33 whaiaift tiia logic meana ia 
qpecabl? ccmnactad to a naster ox^ster and tbB process futtbet 
cdQporisasi 

iapatting alphammeric infosi&ation 
S to a plurality of storage devices within a 

wmotY tteanai 
•inputting control Infrasnaticm to a plucality 

of Btocage devices within the nsnoi^ sieansi 
Inpjtting pcograiBS/ data or oontcol infOr* 
10 mtion. froRi a xaaster ccanpater; and 

salecting and' peocesaing of one or mors 

major functions contained witdiin the ^sogram» 

37* Tbe improved Bulti^inodal autonatad educatlc^taJ and 
entertainment process of daim 33^ wherein the ioajar function 
is a "DEFIHB' function, and the proceas is further 
characterised as conprising; 
5 selecting and processing a predetemined 

snbfoncticn within the ''define" functloiir 
, whet^n^the'^pE o a oe 8sA n g^ te '»acg om ! V^ 
means of the logic ineans tsing operahly 
cmnected to tbe nesKsry means and pxccessed In 
10 accordance with the predetenoined program. 

38. The improved multi^nodal autooatad educational and 
entertainment process of claim 33, wherein the major function 
is a "SOLVE* functionr end tbe process is ftnrther characterised 
as ooui ^ risingr 

5 selecting and processing* a predetemined 

subfunctlon within tbe 'solve' function, 
wherein the processing is acoomplishBd 
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steans q£ the logic oteans being cperahly 
connected to the memory neand and processed in 
aooordasoe with the predetermined progrea* 



10 



10 



39» The linproved multi-oodal atttomated educetlonal and 
entertainnent process of daiA 33^ wherein the najor fanotion 
is 8 •piMt* function^ and the process is £urther characterised 

as ooi^prising: 

selecting and processing a predeterained 

aubfunction within the "play" fiunction/ 
wherein ti« processing is aceaanplished ty 
means of the logic neans, being qperably 
connected to the nsnoty oeans and processed in 
accordance with the predetermnea prograa. 



40 • W ijBproved inalti-wodal automated educational and 
entertainment process of claim 33, wherein the ma^or function- 
is a "SBOW «B? functicm, and the process is further 
Gbaractmrized as eco^isings 
5 selecting and processing a predetermined 

subfvmction with the **ahow me* fimotlon, 
wherein &e processing is accooiplisbed fay 
means of the logic means, being operably 
connected to the memory eeans and processed in 
accordance with the ^edatezsnined program* 

41. The process of claim 33 wherein the production of 
second input signals through a nonpcognltive process is 
characteriaed by a stylus means being- brought into indicia 
marking engagement with a relational input pad meansr 
S activating the pad location and providing input signals to the 
logic means as to the location where mar3cing is accanpliahedr 
the marJdng being indicative of the indicia of the data being. 
Input, followed by the stylus being hrou^t into activating 
engagement with a nonprelational data input pad means 
10 correajsondlng to the previously marked indicia, thereby 

. providing Input to the logic means corresponding; to the indicia 
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narked on the relational pad» 

42, The pcoeefis of claitt 41 idierelii t2tt sailtiple ladida 
tnaxklfls engagem^t oC die mlational pad neans ia foUovad by 
tbft same number of ixkdlcia aarUng ^nigagemdnt ot tbe 
non-relational data input pod iceana, the activation of tbe 

5 non-relational data input pad correapMdlng to the maricad 

indicia on the relational, input pad means ia tiie sane «eqiiaicer 

43. Hbe pcoeess of daisi 33 Wherein the second ii^ut 
signal is produced iss a cognitive process oonQdciaing engaging a 
stylus, means in indicia itatking engagement tdth a relational 
data input pad meana^ marking a desired indicia^ providing 

5 input to the logic means oorrespMding to the pad looation 
vhae marking is acconelishedr transmitting indicia signals 
th«ein ^oduced to- the logic neansr activating an activate 
control pad which directs the logic means to decipher the 
signals pcoduced by the e^lus neans so that the logic means 

10 deciphers and provides feedback information on die indicia 
recognizedr , the stylus being capable of activating eogagement 
with a non-relational data input pad means oorrespoi^ing to the 
previously marked Indicia to provide a correct data input into 
tte logic means, ^fhen AOD-reeogniti<m of the iparked indicia 

IS occurs* 



0Mn_ 
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catioiud ead enteminmenl device 
(tO) having Imp i o v a d ftmstioaal ^coh 
aiDi^ sod wHdi rdatioaal 
positloniag of input data by tho oser 
whidi ontespoad) toieqiik«d nunm* 
al ^eralioiis fflui pioceAues. 7b« de- 
vice coapriMi a taWot (») teviug a 
noiwelB^Attal sectfoa (40, 42 or 44) 
for mpttt of COdBtiol « pxcdefined ia- 
fonDatiaa ud at least oxi9 rdational 
Mtm (?6^ 58, 60. 9 64) to idimt 
of data, a styfai^ (IQIitf acdvadng the 
mm-i^atkm&l exid xdsikmal ttdtoos 
of the tablet p2)^ a microconipmer 
t096 unit (82) for prooessSng dgnah 
Ixom the non-rcIatLona] and tdatloa- 
al 99dSxfM of tiM tablet and a 
osBsoiy im!t, (84) for stoziog pro- 
grams and data base for detcna fritafl 
theaocstacyorinacQizaQr of tha 

pxovidad the jsioroeoBxputer tog- 
(eoait (82). Visaal and audio outputs 
(6^ 1^ can alfio be provided for op- 
asm reinfoitmieat end B powar 
source (80) for activating the device. 
A stquKioe of stepi foi c^aratSag the 

moid-modal amaamtcd cdncational , , ^ . 

.nA MitRHalnmeat device 00) Wider the eontiol of iteied piograms ia also provided. 
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